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BACKGROUND OF THE INVENTION 



5 



Field of the Invention 



The present invention relates to the field of interface 
signaling protocol for mixing signals of different media types. 

Related Art 



images to be shown simultaneously. For example, a user may 
have MPEG-2 video data from one device, such as a MPEG video 
decoder, being shown on a display. At the same time, the user 
could be using data from a second device in order to access the 
15 internet for graphics data. The video and graphics data are 
mixed into one data stream going to the display. A window in 
the display shows the graphics data while simultaneously 
maintaining the video feed to the entire display. 

20 Synchronization is one particular problem when mixing two 

streams of data. In the foregoing example, the MPEG video 
decoder. is sending data to the display at certain output timing 
rates, such as, frame rate, pixel rate, line frequency, etc. 
Graphics data comes from a source device and is sent to the 

25 destination device, the MPEG video decoder. Since the incoming 
data stream is continuous, in order for the graphics data to be 
mixed with the video data, the incoming graphics data stream 



10 



Capturing a window within a display allows for multiple 
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must be synchronized with the video data going to the display 
to have the same output timing rates. These various timing 
rates can be associated with various television formats such as 
Phase Alternating Line (PAL), National Television Standards 
5 Committee (NTSC) , and High Definition Television (HDTV) . 

In the past, synchronization has been accomplished by a 
technique called gen-locking. In gen-locking, a phase lock 
loop between the two devices locks the output timing of the 
10 source device to the output timing of the destination device 
using the vertical synchronization signals. In this manner, 
the incoming graphics data can be easily mixed with the video 
data. 

15 However, gen-locking has posed some problems with jitter 

in the digital domain. Jitter is an error in the pulse 
positioning in the digital data stream and shows up as chroma- 
phase jitter in the analog domain. On the display, jitter 
shows up as small vibrations or fluctuation in a displayed 

20 image. The source of the jitter stems from gen-locking to the 
digital reference of the destination device. Also, poor- 
quality gen- locking circuitry can contribute to jitter. 

The two types of jitter pertinent to synchronizing 
25 between two digital devices are high and low frequency jitter. 
Problems exist depending on which filter is used to combat the 
jitter. If a lowpass filter is used in the phase lock loop, 
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you have better signal quality, but the phase lock loop moves 
with the low frequency jitter and thus the low-frequency jitter 
is allowed to pass giving a jittery picture. Additionally, 
synchronization can be easily lost. 

On the other hand, if a highpass filter is used to filter 
the signal, the high-frequency jitter can be removed through 
various techniques, such as reclocking the signal. However, 
the signal quality is reduced. 

Furthermore, another technique to synchronize two 
continuous streams of data is to use a large buffer, or 
multiple buffers, for holding the incoming stream data, such as 
the graphics data in the above example. The incoming graphics 
data is written into the memory buffer at one rate, the output 
rate of the source device, and read out of the buffer at the 
same rate as the destination device. However, the main . 
disadvantage of this scheme is that it can require a 
significant amount of memory, at least two entire pictures. 

Additionally, with the introduction of high definition 
digital television (HDTV) the buffer size must be increased. 
Increasing buffer size to synchronize the incoming data stream 
reduces the bandwidth available to the display, especially if 
there are multiple windows showing in the display. The result 
is that the required memory bandwidth is increased to prevent 
underrunning the display. 
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Thus, a need exists for a more efficient method for 
mixing signals of different media types. Additionally, a need 
exists for improving bandwidth management when interfacing 
signals of different media types. 
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SUMMARY OF THE INVENTION 

Accordingly, a method and system for implementing a video 
and graphics interface signaling protocol is described. 
The present invention provides for better bandwidth management 
when interfacing signals of different media types. 

Specifically, the present invention discloses a more 
efficient method and system for interfacing different media 
data types. In one embodiment of the present invention, a 
method and system are described for displaying video and 
graphics data of different formats and image frequencies onto 
the same display line. A master device that is continually 
streaming data of a first media type, e.g., video, to a display 
at a certain image rate requests data from a source device one 
line at a time. The incoming line of data, graphics, is sent 
to a FIFO buffer. A mixer associated with the master device 
then aligns the incoming data to the same format and image rate 
used for displaying the first media type. The incoming data is 
then displayed simultaneously on the same line with the data of 
the first media type. 

The master device continually requests lines of data from 
the source device to be simultaneously displayed with the data 
of the first media type, video as in the above example. As 
viewed as an image, windows of video and/or graphics data are 
shown on a display. In this manner two devices generating 
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different media types of data with different formats and image 
frequencies are simultaneously shown on a display. 

These and other objects and advantages of the present 
invention will no doubt become obvious to those of ordinary 
skill in the art after having read the following detailed 
description of the preferred embodiments which are illustrated 
in the various drawing figures. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a logical block diagram of an exemplary 
computer system, or set-top box, or any system with multimedia 
5 capabilities that can implement the interface signaling 
protocol, in accordance with an embodiment of the present 
invention. 

Figure 2a illustrates a display showing graphics data 
10 with a window inside the display showing video data, in 
accordance with one embodiment of the present invention. 

Figure 2b illustrates a display showing a window with 
video data and a separate window showing graphics data, in 
15 accordance with one embodiment of the present invention. 

Figure 2c illustrates a display showing video data with a 
window inside the display showing graphics data, in accordance 
with one embodiment of the present invention. 

20 

Figure 3 illustrates a block diagram of an exemplary 
multimedia system including a video subsystem as a master 
device and a graphics subsystem as a source device, in 
accordance with one embodiment of the present invention. 

25 

Figure 4 illustrates an exemplary multimedia system 
including a graphics subsystem as a master device and a video 
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subsystem as a source device, in accordance with one embodiment 
of the present invention. 

Figure 5A is a block diagram illustrating the 
5 implementation of the interface signaling protocol in a 

multiple output environment, in accordance with one embodiment 
of the present invention. 

Figure 5B is a block diagram illustrating the video and- 
10 graphics interface in a multiple output environment, in 
accordance with one embodiment of the present invention. 

Figure 6 illustrates a timing diagram of the graphics 
interface, in accordance with one embodiment of the present 
15 invention. 

Figure 7 illustrates a timing diagram of the video . 
interface, in accordance with one embodiment of the present 
invention. 

20 

Figure 8 is a flow diagram illustrating steps in a method 
for implementing an interface signaling protocol, in accordance 
with one embodiment of the present invention. 

25 
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DETAILED DESCRIPTION OF THE INVENTION 

Reference will now be made in detail to the preferred 
embodiments of the present invention, a method and system for 
implementing an interface signaling protocol, examples of which 
5 are illustrated in the accompanying drawings. While the 

invention will be described in conjunction with the preferred 
embodiments, it will be understood that they are not intended 
to limit the invention to these embodiments. On the contrary, 
the invention is intended to cover alternatives, modifications 
10 and equivalents, which may be included within the spirit and 
n scope of the invention as defined by the appended claims. 

|4 Furthermore, in the .following detailed description of the 

=F present invention, numerous specific details are set forth in 

as! 

W 15 order to provide a thorough understanding of the present 
O invention. However, it will be recognized by one of ordinary 

fy skill in the art that the present invention may be practiced 

O without these specific details. In other instances, well known 

methods, procedures, components, and circuits have not been 
20 described in detail as not to unnecessarily obscure aspects of 

the present invention. 

Notation and Nomenclature 

Some portions of the detailed descriptions which follow 
25 are presented in terms of procedures, steps, logic blocks, 

processing, and other symbolic representations of operations on 
data bits that can be performed on computer memory. These 
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descriptions and representations are the means used by those 
skilled in the data processing arts to most effectively convey 
the substance of their work to others skilled in the art. A 
procedure, computer executed step, logic block, process, etc., 
5 is here, and generally, conceived to be a self-consistent 

sequence of steps or instructions leading to a desired result. 
The steps are those requiring physical manipulations of 
physical quantities. Usually, though not necessarily, these 
quantities take the form of electrical or magnetic signals 
10 capable of being stored, transferred, combined, compared, and 
otherwise manipulated in a computer system. It has proven 
convenient at times, principally for reasons of common usage, 
to refer. to these signals as bits, values, elements, symbols, 
characters, terms, numbers, or the like. 

15 

It should be borne in mind, however, that all of these 
and similar terms are to be associated with the appropriate 
physical quantities and are merely convenient labels applied to 
these quantities. Unless specifically stated otherwise as 

20 apparent from the following discussions, it is appreciated that 
throughout the present invention, discussions utilizing terms 
such as "accessing" "processing" or "computing" or 
"translating" or "calculating" or "determining" or "scrolling" 
or "displaying" or "recognizing" or the like, refer to the 

25 action and processes of a computer system, or similar 

electronic computing device, that manipulates and transforms 
data represented as physical (electronic) quantities within the 
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computer system's registers and memories into other data 
similarly represented as physical quantities within the 
computer system memories or registers or other such information 
storage, transmission or display devices. 

5 

Referring to Figure 1, a multimedia electronic device 
capable of providing an interface between different data 
signals is shown as system 100. System 100 can include any 
computer-controlled application for interfacing signals of 
10 different media types. In general, system 100 comprises an 
address/data bus or other communication means 120 for 
communicating information, a central processor 101 coupled with 
the bus 120 for' processing information and instructions, a 
volatile memory 102 (e.g., random access memory (RAM), static 
15 RAM dynamic RAM, etc.) coupled with the bus 120 for storing 

information and instructions for the central processor 101, a 
non-volatile memory 103 (e.g., read only memory (ROM), 
programmable ROM, flash memory, EPROM, EE PROM, etc.) coupled 
with the bus 120 for storing static information and 
20 instructions for the processor 101, an optional data storage 
device 104 (e.g., memory card, hard drive, optical disk, etc..) 
coupled with the bus 120 for storing information and 
instructions, a display device 105 coupled to the bus 120 for 
displaying information to the computer user, an alphanumeric 
25 input device 106 including alphanumeric and function keys 
coupled to the bus 120 for communicating information and 
command selections to the central processor 101, a cursor 
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control device 107 coupled to the bus for communicating user 
input information and command selections to the central 
processor 101, and an Input/Output (I/O) device 108 coupled to 
the bus 120 for providing a communication link between computer 
system 100 and a network environment. 

The display device 105 of Figure 1 utilized with the 
multimedia system 100 of the present invention may be a liquid 
crystal device, cathode ray tube, plasma screen, or other 
display device suitable for displaying video and graphic 
images. 

Implementation of Interface Signaling Protocol 

Accordingly, a method and system for implementing a video 
and graphics interface signaling protocol is described. 
The present invention provides for better bandwidth management 
when interfacing signals of different media types. The present 
invention also provides for a more efficient method to mix 
signals of different media types. 

The following section provides an exemplary description, 
of the graphics and video interfaces between two electronic 
devices. It is to be appreciated that embodiments of the 
present invention can be implemented on any number of data 
types and electronic devices. 
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Figure 2a illustrates a display 200 showing two streams 
of media data types, in accordance with one embodiment of the 
present invention. The two streams of data are mixed to create 
two images on the display 200. In Figure 2a, graphics data is 
5 shown to occupy the entire display screen 205. The graphics 
data essentially provides a background screen. A window 210 
that is smaller than the graphics display screen 205 shows the 
video data. It is appreciated that window 210 can be of 
varying size and shape. Additionally, window 210 can be placed 
10 anywhere on screen 205. For example, while on the Internet, a 
user may require a video display of a video clip encoded in the 
MPEG-2 format from an Internet content provider. 

Figure 2b illustrates a display 200 showing two streams 
15 of media data types, in accordance with another embodiment of 
the present invention. The two streams of data are mixed to 
create two images on the display 200. The two images are shown 
in windows of the display. It is to be appreciated that Figure 
2b is exemplary only, and that the windows can be of varying 
20 sizes and shapes. One window may occupy the entire display 
area as in Figure 2a. Additionally, the windows can be 
arranged in any manner to fit on the display 200. 

In Figure 2b, graphics data is shown in a window 215 
25 occupying the lower half of display 200. A window 220 occupies 
the upper half of display 200 and shows the video data stream. 
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A background window 230 can contain other video or graphics 
data or a monochrome color for an unobtrusive background. 

Figure 2c illustrates a display 200 showing two streams 
of media data types, in accordance with one embodiment of the 
present invention. The two streams of data are mixed to create 
two images on the display 200. In Figure 2c, video data is 
shown to occupy the entire display screen 230. The video data 
essentially provides a background screen. A window 235 that. is 
smaller than the video display screen 230 shows the graphics 
data. It is appreciated that window 235 can be of varying size 
and shape. Additionally, window 235 can be placed anywhere on 
screen 230. For example,.- a user may be watching a movie while 
also surfing the Internet in window 235. 

Additionally, it is appreciated that embodiments of the 
present invention can accommodate various formats of video and 
graphics data signals. 

20 Figure 3 illustrates a block diagram of a system 300 

implementing a graphics interface, in accordance with one 
embodiment of the present invention. A master device, the 
video subsystem 305, contains the video decoder engine 310 and 
the display controller 315. The display controller also 

25 contains a video scaler. The display controller 315 sends 

video data from the video decoder engine 310 to the mixer 340. 
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For example, video data, such as a movie coming over the 
satellite, is shown on an HDTV. 

In the graphics interface 350 of Figure 3, the video 
subsystem 305 acts as a master device and continuously outputs 
video data. As a master device, the video subsystem 305 also 
requests graphics data from the graphics subsystem 370 to be 
mixed with the continuous stream of video data. A mixer 340 is 
used to mix or blend graphics data from the graphics subsystem 
370 with video data from the video decoder 310. In one 
embodiment, the display controller 315 interfaces with the 
graphics output unit associated with the graphics subsystem 370 
to request graphics data in graphics interface 350. 

In the present embodiment, the graphics subsystem and the 
video subsystem produce a single output or stream of data to be 
displayed. Also, it is appreciated that the single stream 
video decoder engine 310 can process any video format including 
those complying with the moving pictures expert group (MPEG) 
video format. 

The display controller 315 in Figure 3 drives the various 
display rates, such as the frame rate, pixel rate, line 
frequency, etc., for the video data to be shown on the display 
350. The display controller can handle HDTV, and SDTV 
resolutions, as well as all of the graphics resolution commonly 
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used by CRT displays. Additionally, the display 350 can handle 
various formats, such as HDTV, SDTVs, CRTs, etc. 

Continuing with Figure 3, the master device, the video- 
5 subsystem 305, requests graphics data from the graphics 
subsystem 370 on a line-on-demand basis. As discussed 
previously, the display controller 315 interfaces with the 
graphics subsystem 370 to request graphics data. A graphics 
output unit associated with the graphics subsystem 370 sends 
10 graphics data to a first-in-first-out (hereinafter known as 
n "FIFO") buffer 330. The graphics data may be sent at different 

2 data rates than the rates that drive the display of the video 

data, as discussed in the previous paragraph. A mixer 340 

yy 

overlays, mixes, or blends the graphics data with the various 
ffl 15 video data streams. This, for example, may be required when 
O the user is watching a movie from a satellite feed while 

rU simultaneously viewing graphics data from the Internet. 

Figure 4 illustrates a block diagram of a multimedia 
20 system 400 implementing a video interface, in accordance with 
one embodiment of the present invention. A master device, the 
graphics subsystem 410, contains a graphics processor 415 and 
display controller 417. The display controller also contains a 
graphics scaler. The display controller 417 of Figure 4 sends 
25 graphics data from the graphics processor 415 to the mixer 440. 
For example, graphics data, such as that from Internet web 
sites, is continually shown on a CRT display. 
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In the video interface 450 of Figure 4, the graphics 
subsystem 410 acts as a master device and continually outputs 
graphics data. As a master device, the graphics subsystem 410 
5 also request video data from the video subsystem 470 to be 

mixed with the continuous stream of graphics data. A mixer 440 
is used to mix or blend decoded video data from the video 
subsystem 470 with graphics data from the graphics processor 
415. In one embodiment, the display controller 417 interfaces 
10 with the video output unit associated with the video subsystem 
G 470 to request video data in video interface 450. 

jjj In the present embodiment, the graphics and video 

% subsystems produce a single output or stream of data to be 

^ 15 displayed. Also, it is appreciated that the graphics processor 

R 415 can utilize any graphics format including the red, green, 

W blue (RGB) format. 

The display controller 417 in Figure 4 drives the various 
20 display rates, such as the frame rate, pixel rate, line 
frequency, etc., for the graphics data to be shown on the 
display 450. It is appreciated that the display controller can 
handle HDTV, and SDTV resolutions, as well as all of the 
graphics resolution commonly used by CRT displays. 
25 Additionally, the display 450 is usually a SDTV or CRT; 
however, it is appreciated that display 450 can be one of 
various types of displays, such as HDTVs, plasma displays, etc. 
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Continuing with Figure 4, the master device, the graphics 
subsystem 410, requests video data from the video subsystem 
470, on a line-on-demand basis. More particularly, the 
graphics subsystem 410 may request the video data from a MPEG 
decoder in one embodiment. A video output unit associated with 
the video subsystem 470 sends video data to a FIFO buffer 430. 
The video data may be sent at different data rates than the 
rates that drive the display of the graphics data, as discussed 
in the previous paragraph. A mixer 440 overlays, mixes, or 
blends the video data with the graphics data. This, for 
example, may be required when the user is browsing the Internet 
and needs to display a video clip encoded in the MPEG-2 format. 

Figure 5A illustrates' an exemplary multimedia system 500 
that shows the video and graphics interfaces for video and 
graphics subsystems capable of driving multiple data outputs 
simultaneously, in accordance with one embodiment of the 
present invention. In system 500, a video subsystem 510 is 
outputting video signals for an HDTV or high resolution display 
and sending a separate and distinct video signal to the 
graphics subsystem 520. Additionally, the graphics subsystem 
520 is outputting graphics data to a CRT or SDTV and outputting 
a separate and distinct graphics signal to the video subsystem 
510. It is appreciated that there may be many more video and 
graphics outputs driving other video and graphic displays. 
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Continuing with Figure 5A, a multi-stream video decoder 
engine 512 is capable of generating multiple and distinct video 
data outputs. The multiple outputs can be sent to various 
devices such as an HDTV, a recorder, a graphics subsystem for 
5 generating a video window, etc. One of the outputs is sent to 
the display controller 514 and mixer 518 to drive a display 540 
that is HDTV, or any high resolution display. 

Also, a multiple output graphics processor 522 is capable 
of generating multiple graphics data outputs. The multiple 
outputs can be sent to various devices such as a CRT or SDTV, 
or a video subsystem for generating a graphics window, etc. 
One of the outputs is sent to the display controller 524 and 
the mixer 528 to drive a display 530 that is a SDTV display, or 
any high performance CRT display. 

A graphics interface 550 illustrates how the graphics 
output unit 523 sends graphics data to a video subsystem 510. 
In accordance with the graphics interface 550, the graphics 
output unit 523 sends graphics data to a FIFO buffer 516 in the 
video subsystem 510. The graphics interface 550 is similar to 
the graphics interface 350 described with Figure 3. 

A video interface 570 illustrates how the video output 
25 unit 513 sends video data to a graphics subsystem 520. In 

accordance with the video interface 570, the video output unit 
513 sends video data to a FIFO buffer 526 in the graphics 
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subsystem 520. The video interface 570 is similar to the video 
interface 450 described with Figure 4. 

Figure 5B is a block diagram illustrating the graphics 
5 interface 550. The graphics interface 550 is comprised of a 
data bus and five control signals, in accordance with one 
embodiment of the present invention. Figures 5A and 5B in 
combination with Figure 3 provide an illustration of the 
graphics interface 550. The data bus carries graphics data 
10 alone or graphics data and alpha parameters. 

The data rate on this bus can be up to 74.25 MHz when a 
display resolution of 1920 by 1080 is selected and the refresh 
. +; rate is 60 fields per second in interlaced mode, or 30 frames 

ffl 15 per second in progressive mode. The number of pixels per line 
O being transferred must match the number of active pixels on the 

ft! line to be displayed in the graphics window since the video 

Q subsystem 510 does not perform any processing on the graphics 

data other than blending it with the video data and sending it 
20 to the display, in accordance with one embodiment of the 
present invention . 

Due to the high data rate, a line-on-demand mode of 
operation is implemented. The graphics line request signal 
25 ( XX GR_LINE_REQ" ) 556 is asserted by the master device, in this 
case, the video subsystem 510, a programmable number of clock 
cycles before the beginning of the line is displayed. The 
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graphics output unit 523 must provide graphics data after 
detecting the w GR_LINE_REQ" signal 556. 

In accordance with one embodiment of the present 
5 invention, for best performance, the graphics data must start 
within a narrow window that begins a programmable number of 
clock cycles after detection of the xx GR_LINE_REQ" signal 556. 
After the line of graphics data is sent, the graphics output 
unit 523 waits until another request for a line of data is sent 
10 before sending out more data. 

rg Further, in another embodiment, the graphics processor 

jjj has scaled the graphics data so that the graphics data is 

IE sufficient only to fill one line of the window containing the 

7^15 graphics data. 

O 

W A receive FIFO 516 (as illustrated in Figure 5A) is 

Q provided to allow for precise pixel alignment as done by the 
mixer 518 associated with the video subsystem 510. The FIFO 
20 buffer 516 is configured to avoid overrun or underrun 

conditions when interfacing the graphics and video data. 

A pixel reference clock ( W GR_RCLK") 552 is provided by 
the video decoder; however, the graphics output unit 523 may 
25 choose not to use it as long as it can generate the pixel clock 
"GR_PCLK" signal 554 with sufficient accuracy to avoid FIFO 
overrun or underrun conditions. 
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The graphics interface 550 supports progressive as well 
as interlaced scan modes of operation. These modes of 
operation must be programmed into both the graphics subsystem 
5 520 and the video subsystem 510. 

Continuing with Figure 5B, the x> GR_NEW_FRAME" signal 558 
is asserted to indicate the beginning of a frame, in the case 
of progressive mode. Alternatively, the " GR_NEW_FRAME" signal 
10 558 is asserted to indicate the beginning of a new field, in 
p the case of interlaced mode. This signal 558 is used to 

m synchronize both the video subsystem 510 and the graphics 

jjjs subsystem 520 to the same frame or field. 

^ 15 The graphics output unit 523 in the graphics subsystem 

D 520 samples the request signals to detect the beginning of a 

Ty line or frame/field and determine which field to transfer. For 

O example, if the display controller is operating in interlaced 

mode, an odd field is requested by the simultaneous assertion 
20 of the "GR_LINE_REQ" signal 556 and the " GR_NEW_FRAME" signal 

558. If the line request signal 556 is deasserted, then an 

even field is requested. 

The graphics output unit 523 in the graphics subsystem 
25 520 could prefetch the first line of graphics data from memory 
when a " GR_NEW_FRAME r ' signal 558 is detected. This would 
eliminate potential latency problems. 
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A valid " GR_VLD" signal 559 is sent by the graphics 
output unit 523. along with the " RGB_DATA" signal 560 to 
indicate the start and stop of the graphics data. A valid 
5 signal is provided since the " RGB_DATA" signal 559 does not 
have start or end data indicators. As such, an external valid 
signal 559 is used to indicate the beginning of a line of data 
and the end of the line of data. 

10 In another embodiment of the present invention, if the 

display controller 514 in the master device, video subsystem 
510, is performing frame rate conversion, even or odd fields 
may sometimes be skipped or repeated. 

15 Figure 6 illustrates a timing diagram 600 of the graphics 

interface 550. The graphics pixel clock (" GR_PCLK" ) signal 554 
is shown, the graphics new frame signal ( W GR_NEW_FRAME" ) signal 
558 is shown, the graphics line request ("GR_LINE_REQ" ) signal 
556 is shown, the graphics valid data ( M GR_VLD" ) signal 559 is 

20 shown, and the graphics data (" RGB_DATA" ) signal 560 is shown. 
The graphics reference clock (" GR_RCLK" ) signal 552 is not 
shown since it is an optional signal. Additionally, the 
" GR_NEW_FRAME" signal 558 and the " GR_LINE_REQ" signal 556 are 
generated by the master device, video subsystem 510, 

25 synchronously with the W GR_RCLK" 552 and therefore do not have 
a well defined phase relationship with the W GR_PCLK" signal 
554. 
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In another embodiment of the present invention, the 
graphics data may be overlayed in a window over the video 
display, or the graphics data may be blended with the video 
5 data so that the window of graphics data may fade in or out, or 
may be swiped. This is accomplished by changing the alpha 
parameters in the graphics data. 

In summary, the graphics interface 550 allows for the 

10 simultaneous display of video and graphics data. With 

Q reference to the flow chart as illustrated in Figure 8 of 

m process 800, the display controller associated with the video 

y] subsystem sends a signal to the output unit in the source 

rS device to reset to the beginning of a frame (in progressive 

2* 15 mode) or a field (in interlaced mode) in step 810. Previously, 

r! both the display controller in the master device and the 

^ graphics output unit in the source subsystem have been informed 

O of the mode of operation, progressive or interlaced to be used. 



20 The graphics output unit may not be synchronized with 

data coming out of the video decoder for display, but by virtue 
of the FIFO buffer, but by virtue of the FIFO buffer, it is 
possible to precisely align the video and graphics data. 

25 The display controller in the master device, the video 

subsystem, has the intelligence to know the time needed for the 
data coming from the graphics output unit in the graphics 
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subsystem through the FIFO buffer to be processed and aligned 
with the video data. The display controller in the video 
subsystem waits until a predetermined time before the line of 
the window showing graphics data will be shown on the display 
5 line of the display. In step 820, the display controller in 
the master device sends a request to the source device, such as 
the graphics output unit 523, for one line of graphics data. 

The master device, such as the video subsystem 510, 
10 receives the line of graphics data from the graphics output 
unit into a FIFO buffer in step 830 of process 800. The 
graphics output unit then stops transmitting data and waits for 
another request for a line of graphics data. 



m 15 In step 840, the graphics line of data is aligned with 

R the video data. This process includes the conversion of the 

W graphics data to the same format as that used for the video 

O data, as well as the timing conversions to match the rate of 

the video output data going out of the video decoder. 

20 

Continuing with process 800 for a graphics interface, in 
step 850, once the data signals are aligned, a mixer blends or 
" mixes the line of graphics data with a predetermined line of 
video data. The mixer creates a mixed line of data that 
25 includes graphics and video data. This line containing video 
and graphics data is then displayed on the same line of the 
display in step 860. 
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The display controller will keep requesting lines of 
graphics data to be shown in a window on a display showing 
video data in the background or in another window. Once the 
graphics window is complete for that frame or field, the 
display controller finishes off the frame or field for the 
video signal. At that point the process repeats itself by 
returning to step 810 and resetting the frame or field between 
the master and the slave devices. 



In accordance with one embodiment of the present 
invention, because of the start and stop feature illustrated in 
the line-on-demand graphics interface, the synchronization 
problems normally found with gen-locking the timing signals do 
15 not exist. For example, synchronization is better maintained 
and digital jitter is eliminated without the phase-lock-loop 
circuit used for gen-locking the timing signals. 

Returning to Figure 5B, the video interface 570 is 
20 comprised of a data bus and four control signals, in accordance 
with one embodiment of the present invention. Figures 5A and 
5B in combination with Figure 4 provide an illustration of the 
video interface 570. The data bus carries video data that is 
formatted according to the ITU-R Recommendation 656, otherwise 
25 known as the "CCIR 656" standard. 
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The data rate on this bus is limited only by the 
technology being used. The worst case occurs when the video 
window occupies the entire display area, or when there is a 
very small FIFO buffer associated with the graphics processor. 
5 Assuming a maximum data rate of 75 MHz, this allows for a 

display resolution of up to 1024 by 768 and a refresh rate of 
75 Hz. Larger displays can be supported if the video window 
does not occupy the entire display area and a larger receive 
FIFO buffer is implemented in the graphics subsystem. In this 
10 case, the video interface 570 can be set to run at a rate lower 
than the display pixel rate. The only requirement is that the 
total time needed to transfer a line of video data is less than 
the line scan time of the display. 

15 The mixer 528 in the graphics subsystem 520 mixes and/or 

blends the video data with the graphics data from the graphics 
processor 522 and sends it to the display. No scaling on the 
video data is performed by the master device, the graphics 
subsystem 520, that contains the graphics processor 522. 

20 

Similar to the graphics interface 550, a line-on-demand 
mode of operation is implemented. The video line request 
CVD_LINE_REQ" ) signal 576 is asserted by the master device, in 
this case, the graphics subsystem 520, a programmable number of 
25 clock cycles before the beginning of the display line is 
scanned. The display controller 524, in one embodiment, 
asserts the video line request signal 576. The video output 
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unit in the source subsystem, video subsystem 510, must provide 
video data after detecting the video line request signal 576. 

For optimum performance, in accordance with one 
5 embodiment of the present invention, the video data must start 
within a narrow window that begins a programmable number of 
clock cycles after detection of the line request signal 576. 
After the line of video data is sent, the video output unit 513 
waits until another request for a line of data is sent before 
10 sending out more data. 

Further, in another embodiment, the video decoder engine 
512 has scaled the video data so that the video data is 
sufficient only to fill one line of the window containing the 
15 video data. 



Continuing with Figure 5B to illustrate the video 
interface 570, a receive FIFO 526 (as illustrated in Figure 5A) 
is provided to allow for precise pixel alignment as done by the 
20 mixer 528 associated with the graphics subsystem 520. The FIFO 
buffer 526 is configured to avoid overrun or underrun 
conditions when interfacing the graphics and video data. 



A pixel reference clock ( U VD_RCLK") signal 572 is 
25 provided by the display controller 524 in the graphics 

subsystem 520. However, the video output unit 513 may choose 
not to use it as long as it can generate the video clock 
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rVD_PCLK" ) signal 574 with sufficient accuracy to avoid FIFO 
overrun or underrun conditions. 

The video interface 570 supports progressive as well as 
5 interlaced scan modes of operation. These modes of operation 
must be programmed into both electronic subsystems 510 and 520. 

Continuing with Figure 5B, the xx VD_NEW_FRAME" signal 578 
is asserted to indicate the beginning of a frame, in the case 
10 of progressive mode. Alternatively, the w VD_NEW_FRAME" signal 
$*% 578 is also asserted to indicate the beginning of a new field, 

in the case of interlaced mode. This signal 578 is used to 
if* synchronize both electronic subsystems 510 and 520 to the same 

^ frame or field. 

1 15 

Q The video output unit in the video subsystem 510 samples 

ru the request signals to detect the beginning of a line or 

O. frame/field and determine which field to transfer. For 

example, if the display controller is operating in interlaced 
20 mode, an odd field is requested by the simultaneous assertion 

of the VD_LINE_REQ signal 576 and the VD_NEW_FRAME signal 578. 

If the line request signal 576 is deasserted, then an even 

field is requested. 

25 The video output unit 513 in the video subsystem 510 

could prefetch the first line of video data from memory when a 



NSC-P04896/JPH/LCH 



29 



"VDJSIEW_FRAME" signal 578 is detected. This eliminates 
potential latency problems. 

In another embodiment of the present invention, if the 
5 display controller 524 in the graphics subsystem 520 is 
performing frame rate conversion, even or odd fields may 
sometimes be skipped or repeated. 

Figure 7 illustrates a timing diagram 700 of the video 
10 interface 570. The video pixel clock rVDJPCLK" ) signal 574 is 
q shown, the video new frame signal C VD_NEW_FRAME" ) signal 578 

is shown, the video line request ( w VD_LINE_REQ" ) signal 576 is 
!!j shown, and the video data ( M YCrCb_DATA" ) signal 580 are shown. 

% The video reference clock ("VD_RCLK") signal 572 is not shown 

- M 15 since it is an optional signal. Additionally, the 
O W VD_NEW_FRAME" signal 578 and the w VD_JLINE_REQ" signal 576 are 

FU generated by the master graphics subsystem 520, synchronously 

O with the VD_RCLK 572 and therefore do not have a well defined 

phase relationship with the "VD_PCLK" signal 574. 

20 

Furthermore, contrary to the graphics interface 550, no 
data valid signal is present since the video data is always 
contiguous and the start of line and end of line indicators, 
start of active video (SAV) and end of active video (EAV) , is 
25 implemented via a special code embedded in the video stream. 

This is present in the CCIR-656 standard. For example, an idle 
8010h signal 705 is sent before the active video data. The SAV 
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signal 710 is sent to indicate the start of active video. The 
active video begins with signal 720. The end of active video 
(EAV) signal may or may not be used since the line length is 
usually known to both source and destination subsystems. 

5 

In another embodiment of the present invention, the video 
data may be overlayed in a window over the graphics display, or 
the video data may be blended with the graphics data so that 
the window of video data may fade in or out, or may be swiped. 
10 This is accomplished by changing the alpha parameters in the 
destination subsystem. 

With reference to the flow chart as illustrated in Figure 
8 of process 800, the display controller associated with the 

15 graphics subsystem sends a signal to the source device, the 
video subsystem, to reset to the beginning of a frame (in 
progressive mode) or a field (in interlaced mode) in step 810. 
Previously, both the display controller in the master subsystem 
and the video output unit in the source subsystem have been 

20 informed of the mode of operation, progressive or interlaced to 
be used. 

The video output unit in the video subsystem may not be 
synchronized with the data coming out of the graphics processor 
25 for display, but by virtue of the FIFO buffer, it is possible 
to precisely align the video and graphics data. 
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The display controller, in the master graphics subsystem, 
has the intelligence to know the exact time when the data 
coming from the video output unit in the video subsystem 
through the FIFO buffer needs to be processed and aligned with 
5 the graphics data. The display controller in the graphics 
subsystem waits until a predetermined time before the line of 
the video window will be shown on the display line of the 
display. In step 820, the display controller of the graphics 
subsystem sends a request to the video output unit in the video 
10 subsystem for one line of video data. 

S The master graphics subsystem, receives the line of video 

\\* % data from the video output unit into a FIFO buffer in step 830 

1: of process 800. The video output unit then stops transmitting 

^15 data and waits for another request for a line of video data. 

fU In step 840, the video line of data is aligned with the 

Q graphics data. The video data is converted to the same format 

as that used for the graphics data. 

20 

Continuing with process 800 for a video interface 570, in 
step 850, a mixer blends or mixes the line of video data with a 
predetermined line of graphics data. The mixer creates a mixed 
line of data that includes graphics and video data. The line 
25 of data is then sent to the display to be simultaneously 
displayed in step 860. 
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The display controller in the graphics subsystem will 
keep requesting lines of video data to be mixed with the 
graphics data and shown in a video window on the display. Once 
the video window is complete for that frame or field, the 
5 display controller finishes off the frame or field for the 

graphics signal. At that point the process repeats itself by 
returning to step 810 and resetting the frame or field between 
the master and the slave devices. 

10 In accordance with one embodiment of the present 

p invention, because of the start and stop feature illustrated in 

Si the line-on-demand video interface, the synchronization 

m 

iTi problems normally found with gen-locking the timing signals do 

T«. not exist. 

i> I ' ■ 
■HUT 

' m 15 

J={ While the method illustrated in process 800 of 

Ty embodiments of the present invention show a specific sequence 

Q and number of steps, the present invention is suitable to 

alternative embodiments. For example, not all the steps 
20 provided for in the process 800 are required for the present 
invention. Furthermore, additional steps can be added to the 
steps presented in the present embodiment. Likewise, the 
sequence of the steps can be modified depending upon the 
application. 

25 

The preferred embodiment of the present invention, a 
method and system for implementing an interface signaling 
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protocol, is thus described. While the present invention has 
been described in particular embodiments, it should be 
appreciated that the present invention should not be construed 
as limited by such embodiments, but rather construed according 
to the following claims. 
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